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ABS'fRACT 

Six special education resource teachers pilot tested 
a manual designed to train teachers to use direct and frequent 
measurement tec^n iqu.es to monitor students' progress toward 
individualized goals and to Evaluate the effectiveness of the 
students' instructional program. The accuracy of implementation of 
the procedures described in the manual and teachers' satisfaction 
with these procedures were evaluated, and the amount of time teachers 
spent in these measurement activities was documented. Results 
indicated that the manual was a satisfactory self instructional tool; 
\the teachers were accurate in the implementation of the procedures 
and were highly satisfied with the manual. The primary problem with 
ihe training format was a decrease in teacher efficiency. In contrast 
to findings from more intensive training efforts, the teachers 
trained by the manual alone actually required more time for 
measurement at the end of the project than they had needed 
originally. (Author) 
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Abstract 

Eight special education resource teachers pilot tested a manual 
designed to train teachers to use direct and frequent measurement tech- 
niques to monitor students' progress toward individualized goals and to 
evaluate the effectiveness of the students' instructional program. 
l^e accuracy of implementation of the procedures described in the manual 
and teachers' satisfaction with these procedures were evaluated, and the 

amount of time teachers' spent in these measurement activities wasydocu- 

/ 

merited. Results indicated that the manual was a satisfactory s61f- 
instructfonal tool; the teachers were accurate, in the implementatio*i of 
the procedures 'and were highly satisfied with the manual. The primary 
problem with- the. training format was a decrease in teacher efficiency. 
In contrast to findings from more intensive training efforts, the teachers 
trained by the manual alone actj^ally required more time for measurement 
at the end of the project than they had needed originally. 



Teachers* Use of Self Instructional Materials for 
Learning Procedures for Developing and Monitoring 
Progress on lEP Goals 

Standardized achievement tests have several characteristics that 
render them inadequate for monitoring student progress (of. Fuchs & Deno, 
1981). Within the typical classroom, the teacher requires simple and 
direct measures than can be used daily, if necessary, to monitor students* 
The need is especially great in special education classes, where teachers 
must develop appropriate goals for individual education programs (lEPs) * 
and then must monitor students' progress on those goals* 

Over a five-month period, researchers at the Institute for Research 
on Learning Disabilities (IRLD) pilot tested a manual designed to train 
special education resburce teachers to (a) use direct and frequent measure- 
ment techniques in monitorir^g students' progress toward individualized ^ 
goals, and (b)Amodify educational procedures ^t)ased on the information 
obtained frpm measurement • The training manual was tested within a 
school-based setting in. order to (a) determine whether teachers could 
accurately implement the procedures,.described in the training manual with 
minimal assistance from the manual developers^ and (b) evaluate teacher 
satisfaction and attitude toward the training materials and the progress 
monitoring procedures detailed in the manual. In addition, the amount of 
time teachers spent in these measurement activities was documented (see 
Fuchs, Wesson, Tindal , Mirkin, & Deno, 1981, for details on the efficiency 
of the teachers who participated in this study). 



Method . 

• ■ 

Subjects ^ ^ ' 

The subjects in the pilot test of the fnanual were eight female 
special education resource room teachers from a suburban school district* 
Teaching experience ranged from 1 to 35 years, with 3*5 being the median 
number of years in regular education (X = 5 .75) and 3.0 the median^number 
of years in special education (X" = 5.85), Two of the eight teacherl' 
held masters degrees; the remainder held a B,S, asjthe highest degree 
earned. All of the teachers were certified in special education; five 
of the ei|ht had earnecJ more than one teaching certificate. Of , the 15 
certificates held by th'^se eight teachers, five were in learnVg disa- 
bilities, three in elementary education, titio e.ach in emotiotiaV disturbance, 
trainable mentally retarded, and educable mentally retarded, and one in 
general special education. Two of the subjects wHhdrew from the study 
after the first twp weeks of data collection. Only the data. from the 
'six teachers who voluntarily continue"?* through the remainino 13 weeks 
of the study are reported here. 
Procedures 

Training Manual . The training manual was a direct output of a year 
long research/training project in a rural special education cooperative 
that included six school districts. In that project, special education 
teachers were trained through workshop^ presentations to measurs and graph 
student performance in reading, spelling, and writtten expression, to write 
long-term goals and short-term objectives that subsequently could be moni- 
tored through a measurement system based on the students' mainstream 
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curriculum, and to use the information obtained from measurement to 
determine when modifications in the student's instructional plans were 
necessary • Based on this workshop training, a manual was developed to 
present the same procedures with minimal supervision and few personal 
contacts between the teachers and the developers of the manual. 

The manual v;as presented in three parts • The first part was de- 
signed to train teachers in the measurement techniques. It consisted 
of five units: reading, spelling, written expression, social adjustment, 
and graphing. Specific directions for .administering the measurement tasks 
were included, along with practice measurement materials (word lists for 
reading and spelling, and sample story starters for written expression)* 
The graphing unit instructed teachers in the procedures for labelin-g 
graphs and plotting scores. 

i Part 2 of the manual also consisted of five units. Unit 6, 
the first unit in Part 2, defined the distinction between progress 
and performance measurement. Units 7 and 8 described the procedures 
for writing long-range goals and short-term objectives, respectively. 
The Steps for designing a measurement system based on the curriculum 
•materials were outlined inHjnit 9. Unit 10 provided instructions for 
implementation of the techniques detailed in Units 6 through 9. 

Part 3 of the manual contained three units. These units instructed 
teachers in procedures for using the information obtained from measurement 
to monitor progress toward the long-range goal^ and short- term objectives 
and. to modify instructional plans based on the students' performance. 
Unit 11 focused on specifying an instructional plan that included the in- 
structional procedures, materials, tin^e setting, and motivational strate- 
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gies* "Two options for using the student's performance data to monitor 
progress and to determine when changes in the instructional plans are 
necessary were specified in Unit 12, Unit 13 discussed the procedure 
for changing instructional plans • 

Workshops > A series of three 45-minute workshops were held to intro- 
duce the teachers to each of the three parts of ttie training manual. The 
workshops wer^ gear^ed simply to describe the purpose of each part of the 
manual and to guide the teachers through the manual in order to familiar- 
ize them* with its organization. No actual training in the imjplementation 
of the procedures was conducted, although teachers were free to ask ques- 
tions for clajrification. A fourth workshop provided the teachers with 
an oppo»|;iinity.>for shading their reactions to the manual itself and to 
the measurement and goal monitoring procedures. 
Dependent Measures 

Accuracy of Implementation , Data on the'^feachers ' accuracy of imple 
meating the" procer'.^es was derived from an implementation checklist. 
Observations of teacher measurement behavior were made twice during the 
weeks following introduction of Part 1 of the manual. During these obser 
vations, the following Accuracy of Implementaticin criteria were used to 
assess each teacher's performance in administering the measurement tasks 
and graphing data: 

Behavior Criteria 

A, Measure and score the student's With 100^ accuracy, where accurate 
performance in each area using measurement is defined as: 

the materials in the manual and 

identify the appropriate level 1. Bringing stopwatch, pencil to 

at which subsequent measurements measurement area, 

will be conducted, 

2, Selecting appropriate stimulus 
materials for both teacher and 
student. 



3. Giving correct directions t'or 
the task. 

4. " Administering the measurement' • 
. procedure for the correcv time 

period. 

5. Correctly scoring 'the test protocol. 

B. Record both correct and incorrect With lOOX accuracy, where a correctly , 
scores on a labeled graph. labeled graph cons-ists of: 

1. The dates filled in on the 
abscissa. 

2. The ordinate correctly labeled. 

3. The units of measurement specified. 

4. The student's name, teeicher's 
name and subject area identified. 

5. A key identifying the symbols 

fcr correct and incorrect scores. * 

6. Symbols placed at the correct in- 
tersection of date and score. 

/. Consecutive data points connected 
with straight lines. 

8. Absences recorded on the graph 
as (abs.) on the correct drtes. 

Two weeks following the introduction of Part 2 of the manual, the graphs, 
long-range goals, and short-term objectives that teachers had developed for 
target students were inspected to determine whether the following criteria^ 
were met: 



Behavior Criteria 

C. Write a long-term goal In each With 100% accuracy with the procedures 

area. described in Unit 6 as follows: 

1. Goal specifies th? number of weeks 
until next review. 

2. Goal specifies student behavior. 
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3. Goal specifies mastery criterion, 
which is: 



Record and graph the student's * 
correct and incorrect scores on 
a labeled performance graph. 



' a, for reading: grade 1*2, 
5*0 wpm with 5 o.^ fewer 
errors; grade 3-6, 70 wpin 
with 7 fewer errors • 

for spelling: grades 1-2, 
40 letter sequences or 5 
*^ words correct per 2 minutes, 
grades 3-6, 60 letter se- 
quences correct or 8 words • 
correct per 2 minutes. 

c. for written expression: a 
rate based on the formula, 
(baseline median x appropriate 
^ multfplter + total words 
actual mean score) /2 

* d. for soc'^al behavior: ai level 
3-5x less or 3-5k more thanr 
current level • 

Such that the graph incorrectly 
labeled and data are recorded accur- 
ately, with: 

1. The dates filled in on the 
abscissa. 



2. The ordinate correctly labeled. 



3, The units of measurement specified, 

4, The student's /lame, teacher's 
name and subject area identified. 

5, A key identffying the symbols 
for correct and incorrect scores • 

.6. Symbols placed a^t the correct 
intersection of "(late and scores 

7. Consecutive data points connected 
with straight lines. 

8. Absences recorded on the graph* 
^t (abs.) on the correct dates. 



Write a short term objective in 
each area. 



Such that the short-term objective 
is loot accurate, with the procsdures 
described in Unit 8 (for performance 
charting): 

1. 'Objective specifies the stimulus 

material (see LRG). 

0 • 

2. Objective specifies the student 
behavior. 
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3. Objective specifies the average 
Increase in performance per week; 
that is, [(desired performance- 
^ actual performance )/nuinber of 
weeks until annual review]. 



to assess the accuracy of implementation following the teacher's Intro- 
auction to Part 3 of the manual, teacher's graphs were exam.ned. The 
following was monitored: \ 



Behavior 
F. Oer.ign a measurement system. 



. ^ Criteria 

Such that the measurement system is 
complete, is consistent with the 
teacher's selection of progress o^ 
performance charting, and accurate 
with respect to procedures identified 
in Unit 12. 

Completeness for performance measure- 
ment includes statements of the fre- 
quency or measurement {at least twice 
weekly), the stimulus format (dependent 
on domain) the stimulus material selec- 
tion: procedure (random selection from 
the annual ooal materia) for reading 
and spelMng, story starter for written 
expression), the test adm1nistra^t1o» ^ 
. procedure, the scoring procedure, and >^ 
the graphing conventions. 



Teachr^r Satisfaction . Teacher satisfaction with the continuous eval- 
uation system and wttfi the training manual was assessed through responses 
to three questionnaires -that w6re administered following implementation of 
Parts 2 and 3- of the training. manual and- at the coi«.pletion of the project.' 
These questionnaires addressed issues of the usefulness of the measure- 
inent procedures outlined in the manual, the clarity and usefulness of 
each unit of instruction, and the degree of difficulty in reviewing and 
using the materials. 'Responses to questionnaire items were tallied and 
medians computed. . , . . • 
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Teacher Efficiency ^ Teacher efficiency was assessed as the amount 
of time engaged in preparing for, administiering, and scoring and graphing 
the measures in reading, spelling, or wff^Aen e)f^ression. The dependent 
data for teacher efficiency were operationalized as fol'l^ws : 

Operation #1 > Measurement preparation while student was not present: 

While student was not present, the teacher found '^and seY^cted 
student sheet(s), teacher sheet(s), graph, and necessary equipment 
(stopwatch, pencils, acetate sheet, grease pencil, etc.). The 
teacher also put away materials while student was not present. 

To measure this teacher behavior, the observer began the 
stopwatch as the teacher first touched materials in preparation 
for measurement* The observer continued to tirrte .through niinor 
interruptions such as phone calls and teacher/principal inter- 
ruptions in preparation time. The observer stopped the timer 
~ ■ as the teacher finished preparation. The observer also timed 
the teacher as he/she. put away student materials. The teacher 
indicated the number of students for whom materials had been 
prepared and put away. 

Operation #2 . Measurement' preparation while student was present: 

While student was present, the teacher found and selected stimulus 
material, response sheet, graphs, and necessary equipment (stop- 
watch, ^pencils, acetate sheet, grease pencil, etc.). The teacher 
also put away materials while the student was present. 

To measure this teacher behavior, the observer began the 
stopwatch as the teacher first touched materials in preparation 
for measurement. The observer continued to time through minor 
interruptions, but stopped timing for major interruptions such 
as student fights, student temper tantrums, principal visits, 



etc. The observer stopped the timer Si. thie teacher finished 
preparation. The observer also timed as teacher put^away 
materials. The observer indicated the number of students for 
whom materials had been prepared. 

Operation #3 . Directions: The teacher provided instructions to the 
students. 

To measure this teacher beha ior, the observer began the 
stopwatch as the teacher inftiated instructions. Timing was 
terminated when the teacher finished giving instructions. 

Operation #4 . Scoring and Graphing: Having administered the test, 
the teacher scored and graphed student performance. 

To measure this teacher behavior, the observer began the stop- 
watch as the teacher began scoring and stopped immediately after 
performance was graphed. This was done for each area the teacher 
scored and graphed. 

'Following implementation of Part 1 of the manual, teachers were 
observe'* as they were engaged in the standard measurement tasks devised 
by the IRLD staff. During the final Weeks of the project, teacher^^ observed 
their own efficiency^while they measured one student's behavior in a n.jas- 
urement task that the teacher had developed. An Observation Recording 
Sheet (see Appendix A) was used to assist in the monitoring of 
teacher efficiency. 

Resul tjs 

Accuracy of Implementation 

Results of two observations following implementation of Part 1 of 
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the manual revealed that most|^eachers accurately measured and scored 
the student's performance in reading (isolated words and reading in 
context), spelling, and written expression. An average of 85% of 
the teachers met the five criteria pertinent to measuring and scoring 
(see Table 1). During the first observation, the criterion which was 
met least often (80% of the timfe) was that of administering the measure- 
ment task for the correct time period. The results of the second ob- 
servation, conducted one week later, revealed that 88% of the teachers 
met this criterion. During thie second observation, the criterion met 
least often (60% of the time) was that of giving correct directions for 
the task. 

Insert Table 1 about here 

The accuracy with which teachers graphed"data also was assesse^i^ff^ 
this time. On the average, the eight criteria specified here (see 
Behavior B) were met 76% of the time. Of the eight criteria, the three 
met least frequently were; (a) absences recorded on the graph (26% of 
the time), (b) the ordinate correctly labeled (51% of the time), and 
(c) a key identifying the symbols (62% of the time). On the average, 
18 Part 1 accuracy of implementation criteria were met 81%-of the time. 

Following implementation of Part 2 of the manual, teachers' accuracy 
in writing long-term goals was assessed. All teachers who wrote goals 
in reading (N=3) met the specified criteria (see Behavior C) . The two 
teachers who wrote goals in spelling used the correct form in writing 
the goals but did not use the correct mastery criterion (see Behavior 
C). None of the teachers had written goals in written expression or 
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social behavior. An average of 75% of the teachers met the eight 
criteria included in accuracy of recording and graphing student per- 
formance (Behavior D). All teachers labeled the graph, the units, 
and connected the data points with straight lines. Only 60% of the 
teachers correctly labeled the ordinate. All other criteria were met 
by 80% of the teachers. All teachers correctly wrote performance 
short-term objectives (see Behavior E) . 

Following implementation of Part 3 of the manual, teacher accuracy 
in designing a measurement system (Behavior F) was assessed. All but 
one teacher (80%) met the required criteria. 
Teacher Satisfaction 

Teachers' responses to the three questionnaires were calculated on 
a four-point scale, with 4 being the high rating and 1 oeing low. Re- 
sponses from the first questionnaire indicated that teachers rated 
measurement results as moderately useful (X = 2.7), but only one of the 
six teachers had Used the information obtained from measurement. Teach- 
ers judged the instructional programs devised for their target students 
as moderately effective to very effective (X = 3.3). The mean difficulty 
rating for using the procedu^^es described in the manual was 1.2 (1 = 
ndt difficult and 2 = somewhat difficult) for Unit 11 (Specifying an 
Instructional Plan), and 1.3 for Unit 12 (Using the Student's Perform- 
ance Data). The clarity of Units 6 (Progress Charting versus Perform- 
ance Charting), 7 (Writing Long-Range Goals), 8 (Writing Short-Term 
Objectives), and 9 (Designing a Curriculum-Based Measurement System) 
was rated as 3.3, 3.5, 3.8, and 3.6, respectively. Mean ratings for 
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usefulness of these same four units was 3,0» 3,5, 3.3, and 4.0. (See 
Appendix B .) 

The questionnaire administered following Part 3 of the manual 
yielded similar results. The usefulness of measurement results was 
rated as 3.2 on the average, with five of the six teachers stating 
that they had used the measurement information. The effe^^tiveness 
of the instructional program received a mean rating of 3.2. Unit 10 
(Implementing the Evaluation System) and U^it 12 (Data Utilization) 
were rated as somewhat difficult. The clarity of Unit 11 (Specifying 
an .Instructional Plan), Unit 12 (Data Utilization), and Unit 13 (Chang- 
ing the Instructional Plan), was rated as 3.5, 3.2, and 3.3, respectively, 
with a rating of 4 being very clear. The usefulness of these units was 
judged to be 3.4, 3.0, and 3.0 on the four-point scale. One teacher 
commented, '^Excellent material on aimline and therapeutic technique. 
This is new to me and very useful." (See Appendix C.) 

The questionnaire administered at the conclusion of the research 
project also was based on a four-point scale, with four being the high 
rating. Teachers were moderately interested in having their school dis- 
trict adopt the manual's procedures fo^writing lEPs (X = 2.8) and for 
monitoring and evaluating progress on lEP goals (X = 3.0). With respect 
to applying these procedures to the. entire caseload, teachers judged 
that this endeavor would be somewhat difficult to accomplish (5( = 2.0) 
and would be moderately useful (X = 2.5). Teachers' responses to the 
open-ended question, "What is your opinion of this approach to writing 
lEPs and evaluating student progress?" were: 
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0) Very clear, meaningful and visual for reporting progress. 
(2). Somewhat lielpful, very time consuming. 
.(3) It is a good approach that is specific. 

(4) I really like it and c^Jld find it effective. 

(5) An excellent way to visualize progress and be more specific 
as to mastery of each goal. 

C6) With supporting research data [this approach] can be a boon 
to special education. 
Teachers also listed a number of advantages and disadvantages to this 
system of writing and evaluating lEPs; these are included ir Table 2. 
The final question asked for teacher estimates of the percent of ti^ije 
spent with the student collecting data. Half the teachers festtmited 10% 
and the rest estimated 25% to 30%. (See Appendix D.) 

Insert Table 2 about here 



Teachc^r Efficiency 

The median time spent by teachers to prepare, give directions, and 
score and graph measurement results for one academic behavior using the 
IRLD measurement tasks was 2 minutes and 2 seconds per task following 
tr'.ining on Part 1 of the manual (see Table 3). At the conclusion of 
the project, teachers collected data on their own behavior to determine 
time spent in measurement when they used their own measurement system. 
The results revealed a median time of 15 minutes per task. 

Insert Table 3 about here 
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- Discussion 

The teachers in thts study were trained in frequent and direct 
measurement. primarily through the use of a training manual. Several 
brief workshops provided an overview of the framework for the manual 
and clarification of the directions in the manual- The results indicated 
that this training format was successful. The majority of teachers we^re- 
able to accurately implement the procedures and wer6 highly satisfied 
with the manual as a training tool. However, the main drawback of this 
minimal training effort, which was much less than the intensive training 
usually conducted, was a decrease. in teacher efficiency. As reported 
by Fuchs et al . (1981), teachers who participated in more intensive / 
training over a longer time period increased, their efficiency signifi- 
cantly. In contrast, the teachers in this study actually required more 
time for measurement at the end of the project than they' original 1y had 
needed. This reduction in efficiency may have been due to the lack of 
focus on efficiency as an. important goal and also to the fact that these 
teachers measured the behavior of. only one student. If teachers had 
applied this approach to a greater portion of students on their caseload, 
the importance of efficiency might have been self evident. A second 
possible explanation for the observed decrease in efficiency might be 
related to the measurement task itself. The tasks initially required 
of teachers were developed by IRLD staff and were designed to promote 
efficiency. When teachers were required to develop their own measure- 
ment materials, the time required in preparing, administering, scoring, 
and graphing was increased. The manual did not address the issue of 
how to increase efficiency of measure.ment under these conditions and 
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most of the teachers in the study apparently did not inv'ffstigate 
c alternatives that would promote greater efficipncy. Since the major 
criticism of continuous evaluation procedures is their time-consuming 
nature, future training materials should included procedures that 
train teachers in measurement efficiency. 
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Table 1 

Percentages of/Teachers Accurately Implementing Behaviors 



iBehavior 



Criterion 



A 

. (First 
iObservati^;) 



A 

] ( Second 
lObservation) 



A 

|(Both 

lObservations) 
B 



Reading* in 
Context 



kCv^o'ng in 
Isolation 



Spelling 



Written 
Expression 



Social 
Behavior 



Averag 



1 


.83 


.88 


1.00 


.86 




.89 


2 


1 .00 


.88 


1,00 


.71 




.90 


3 


.83 


.88 


.88 


.86 




' .84 


4 


.83 


.75 


.75 


.86 




.80 


5 


1.00 


.86 


.83 


1 .00 


• 


.92 


Average 


.90 


.85 


.89 


.86 


0 


, .87 


1 ' 


1 .00 


1 .00 


.83 


. 1.00 




.96 


2 


1.00 


1 .00 


1.00 


.83 




.96 


3 . 


.38 


.50 


.33 


.83 




.60 


4 


.88 


1 .00 


.'83 


,83 




.88 


5 


.86 


1 .00 


.57 


.83 




.82 


Average 


.82 


.90 


.71 


' .86 




.82 


Average 


.86 


.88 


.80. 


.86 


0 


.84 


1 


.71 


.86 


1.00 


1 .00 


1 00 .91 

< 


2 


.43 


.71 


.43 


.66 


.33 .51 


3 


1 .00 


1 .00 


1.00 


1.00 


1.00 1.00 


4 


.86 


1 .'oo 


.'86 


1.00 


.83 .91 


5 


.86 


■ .86 


.71 


.33 


.33 .62 


6 


,86 


.1 .00 


1.00 


1.00 


1.00 .97- 
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Table 1 (continued) 



.Behavior 



Criterion 



Reading in Reading in 
Context Isolation 



Written 
Spelling Expression 



Social 
Behavior 



Average 



7 

8 

Average 

1 

2 

3 

Average 

1 

2 

4 - 

5 

6 

7 

8 

Average 

1 

2 
3 

Average 



.86 
.29 
.73 

1.00 
1 .00 
1.00 
f.OO 

.80 
.60 
1 .00 
1 .00 
.80 
.80 
1.00 
.00 
.75 

1.00 
1 .00 
I'.OO 
1 .00 
80 



,86 
.00 
.79 



.86, 
.00 
.73 

1 .00 
1 .00 
.00 
.67 



1 .00 
1 .00 
.87 



1.00 
.00 
.69 



.86 
.26 

.76 



Table 2 

Advantages and Disadvantages of Continous Evaluation Reported by Teachers 



Advantages 

good for children 

freedom tc use appropriate approach 

very individualized for each student 

can be measured easily once system is estab- 
lished (and not In addition to another system) 

clear and concise 

very structured, organized 

clear for parents as well 

easily reviewed at parent conferences 

less time consuming 

less repetition 

proof of progress 

progress is visible to student 

the STOs "spell out" well and become realistic 
"enablers!' in accomplishing LRGs 

consistent throughout the district; if a student 
should change schools 



Disadvantages 



very time constiming 

% of time with student in testing 

the paperwork (testing, charting, word lists, 
adaptation of present curriculum, etc.) 

don't have ready-made charts; paperwork; storage 
needs 

time and number of workshops and training sessions 
both Special Ed. and mainstreaming teachers' 
time 

that the research data behind the reliability and 
validity of the measurements do show growth in 
the student (both so the parent understands ar^d- 
the mainstream staff u*tderstands) 

it would be difficult to change; all teachers 
should be in agreement of this system 

need for in-service 



Table 3 

Median Times Spent by Teachers in Measurement Tasks 





Subject 


Seconds 


No of 
Areas 


Seconds 
per Task 


First Observation 


1 


521 - 


4 


130.25 




2 


533 


4 


133.25 . 


* 


3 


1125 


4 


281.25 




4 


819 


2 « 


409.5 


Second Observaticn 


1 


565 




141.25* 




2 


577 


*•> 

• 4 


144.25 




3 


373 


' " 4 


93.25 


» 


4 


459 


4 


114.75 




5 


. 796 


• 4 


199 



♦Median scowr^ 141.25 = 2 minutes and 21 seconds 
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APPENDIX A 



Observation Recording Sheet 



Name 



Date 



PREPAKATION 
WHILE STUDENt 
IS NOT PRESENT 


TI>IE: 




TIME: 




TIME: 




[ifSTOS*: 
TIME: 


1 


[#STUS: 
TIME: 


1 


[#STUS: 
TIME: 


1 




[tfSTOS: 


1 


[#STUS: 


3 


[ifSTUS: 


1 






PREPAKATION 
WHILE STUDENT 
IS PRESENT 


TIME: 




TIME: 




TIME: 




[ifSTUS: 
TIME: 


1 


■ [tfSTUS: 
TIME: 


1 


[#STUS: 
TIME: 


1 




[ifSTUS: 


1 


[tfSTUS: 


1 


[j?STOS: / 

















DIRECTIONS 
FOR TASK 

* 


READING IN 
ISOLATION 

TIME: 


READING IN 
CONTEXT 


SPELLING 


WRITTEN 
EXPRESSION 


TIME: 


TIME: 

[j?STUS: 1 


TIME: 


[#STUS: 1 


[lIFSTOS: 1 


[i?STOS: 1 












SCORING & 
GRAPHING 


TIME: 


TIME: 


TIME: 


TIME: 











ERIC 



* #STOS » 9 STUDENTS 

INDICATE ONLY IF GREATER THAN 1 
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APPENDIX B 



Results From Questionnaire Following Implementation of 
Part 2 of the Manual 

M=6 



1) lEP Area 

Spelling - 2 
. Reading - 3 

Written Language - 1 

How often? 

2x/wk - 2 
3x/wk - 4 
4x/wk - 1 



2) Rate the Usefulness of the measurement results that you have 
collected from the students . 

4 13 2 1 

Very Useful Moderately Somewhat Not at all Useful 

Use ful Useful 

1 \ 3 1 

I 

*"But the material fjJevelop for my student will be very useful- 
I appreciate this input to measure progress, even though the 
first stage wasn't useful in direct appl ication." 



3) Have you used the information that you collected through measurement ? 
YES ' NO 

(no) - however,' I shall implement a change in my performance technique 
in the 81-82 school year. 

(yes) - to help design comprehensive goals for this scudent and modify 
present reading and spelling and written language goals and 
objectives. 



! 
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4) 6iven the student with whom you are currently practicing DPBM, 
rate how effective your Instructional program has been up to now. 



Very effective 



Moderately 
Effective 



2 ' 

Somewhat 
Effective 



1 

Not Effective 



2 4* 0 0 

* new student from another district, so hard to measure. 

5) How difficult was it for you to develop an unstructured plan 
for your target student using the procedures specified in Unit 



XI? 



Very Difficult 



Moderately 
Difficult 



Somewhat 
Difficult 



1 

Not Difficult 



1 



6) How difficult was it for you to review the materials and use tne 
procedures specified in Unit XII? 



Very Diffi.cu=lt 



Moderately 
Difficult 



Somewhat 
Difficulc 



1 

Not Difficult 



1 



Clear 



Useful 



Unit 


4 

Very 


3 

Mod. 


2 

Some 


1 

Not 


No 

Answ 




Unit 


4 

Very 


3 

Mod. 


2 

Some 


1 

Not 


No 

Answ 


VI 


4 


0 


2 


0 


0 




VI 


2 


0 


2 


0 


2 


VII 


5 


. 1 


0 


0 


0 




VII 


2 


2 


0 


0 


2 


VIII 


4 


1 


0 


0 


1 




viii 


1 . 


2 


0 


0 


3 


IX 


3 


2 


0 


0 


1 




■■- XI 


3 


0 


0 


0 


3 
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8) Suggestions and comments. 

Unit VI - The difference between progress and performance is 
not clear. 

The difference between the two measures is difficult 
to see at first. 



Unit VII - Very clear; good examples. 

I don't understand. why on pg. 9 the second goal is 
incomplete. 

Unit Vin - Very clear; good examples. 

Would be quicker if you provided answers for math 
problems to make sure one is doing the problems 
correctly. 

Difficult to develop the STO for performance measure 
strategy using "isolated words" as a me^-^rement t 
there seem only to be "readinn in context" examples 
to follow. 



Unit IX - Very well written, easily understood and easy to 
follow. 

Clear. 

I need a bit more time to design my measurement system 
since I have selected a different student to do the 
measurement. 



General conrient: 

They are all useful, yet they all become part of a total lEP 
which encompasses many areas.... A total overhaul of District 
#16's lEP, LRG and STO forms would be beneficial to realize 
the use of this process and procedure which involves a whole 
lot of time and energy. 
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Results from Questionnaire Following Implementation of 
Part 3 of the Manual 

N=6 



1) lEP Area 

Spelling - 2 
Reading - 1 

Reading Isolated Words - 2 
Wri tten Language - 1 



How often? 

Ix/wk - 1 
2x/wk - 3 
3x/wk - 1 
4x/wk - 1 



2) Rate the usefulness of the measurement results that you have 
collected from the studentsT 

4 ' 3 2 ^ 1 
Very Useful Moderately Somewhat Not at all useful 
. ■ Useful Useful 

2 3 1 0 . 

3) Have you used the information that you collected through measurement? 

YES-^ NO 
5 1 ' 

(no) - The timing of this program was inappropriate. We had already 

established our plan';j;or the year (didn't understand) just 

what I was to do. 

(yes) - for program planning las^essment. 

- incorporate -techniques into our Woodcrest spelling series. 

- to modify and enhance student's total program with respect to 
language. 

, - to help kjds recognize what they are doing wrong. Makes 
the discrepancy plain and explainable. 

- developing goals and short term objectives. 
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4) Given the student with whom you are currently practicing DBPM . 
rate how effective your instructional progyam has been up to~now. 



4 

Very Effective 


3 2 
Moderately Somewhat 
Effective Effective 


1 

Not Effective 


2 


- 3 1 


0 


How difficult WfaS it for you to develop an unstructured plan for 


Your target student using the procedures specified in Unit XI? 


4 

Very Difficult 


3 2 
Moderately Somewhat 
Difficult Difficult 


1 

Not Difficult 


0 


2* 2** 


2*** 



♦ lots of reading and time involved 
** no time to make changes at this. time 
*** however, a #4 in the demands on our time 

6) How difficult was it for you to review the materials and use 
the procedures specified in Unit XII? 



4 3 * 2 1 

Very Difficult ' Moderately Somewhat Not Difficult 

Difficult Di fficult 



1* 1 2 2 

* no time; not the materials 



7) Rate the clarity and usefulness of each of the units. 



CLEAR . USEFUL 



Unit 


4 

Very 


3 

Mod. 


2 

Some 


1 

Not 




Unit 


4 

Very 


3 , 
Mod. 


2 

Some 


1 

Not 


N/A 


XI 


4 


1 


1 


0' 




XI 


. 2 


1 


2 


' 0 


1 


XIX 


3 


2 


0 


1 




XII 


2 


1 


2 


Q 


1 


XIII 


3 


2 


1 


0 


\ 


XIII 

w- 


2 


1 


2 


0 


1 



8) Suggestions and conwnents. 

Unit XII - Excellent materials on aimline and theraputic techfiique. 
This is neii to rae and very useful • . 

I wasn't able to compute the median and come up^with 
the same score as you on pg, 8, Fig- D or pg, 10, Fg, 6, 

General Comments 

It is all useful information, but tisdious to go th-^ough 
given our time frame and commitment at school and our 
students. 

Units fell out and were out of order, /Number the pages- 
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APPENDIX D 

Results from Questionnaire at th6 Completion of the Project 

N=6 • ^ ' 

1) How interested would you be in having vour sch ool district adopt 
these procedures for writinp lEP's? 

1 2' ■ 3 4 
Not Interested Somewhat Moderately Very 
Interested Interested - Interested 

0 2 3 1 

2) Ho w interested would you be in having your school district adopt 
thesTprocedures for monitoring and evalu atioTi progress on lEP goals? 

1 , 2 3.4 

' Not Interested ' Somewhat Moderately Very 
Interested , Interested Interested 

0 1 4 1 

3) Hqw easy. would it be to Implement these procedures wit h all the 
students in your case load? 

t> 

12 3 4 
Not Interested Somewhat\ Moderately Very 
Interested \. Interested Interested 

2 ' 1 



4) How useful would it be to imp l ement these proc edures with all the 
students on your caseload? \ 



1 2 3 \ ., 4 

Not Interested Somewhat Moderately . Very 

Interested Interested^. Interested 



\ 

\ 



1 
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5) What Is your opinion of this approach to writing lEP's and 
evaluating student progress? ^ 

- Very clear, meaningful . and visual for reporting progress. 
Somewhat help; very tim^ consaming. 

- It is a good approach that is specific. 

- I really like - could find it effective, if ail othe?' things 
being equal . 

- A. excellent way to visualize progress and be more specific as 
to mastery of each goal. 

- With supporting research data can be a boon to Special Ed. and 
LD IX District #16 releases us from their finding rules of IE*' 
writing and evaluating procedures. y 

6) What are the' advantages of this system of writing and evaluating lEP's 

- good for children 

- freedort. to use appropriate approach ^ 

- very individualized for oach student 

- xan be jmeasured easily once system is established (and not in 
addition to another system} 

- clear and concise 

- very structured, organized 

- clear for parents as well 

- easily reviewed at parent conferences 

- less time consuming 

- less repetition 

- proQf of progress 

- the STOs "spell out" well and become realistic "enablers" in 
accomplishing LRGs. 

- consistent throughout the district; if a student should change schools. 

! 



I 
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7) What are the disadvantages of this system of writing and evaluating 
lEPs? 

- very time consuming. 

- % of time with student in testing 

- the paperwork (testing, charting, word lists, adaptation of present 
curric, etc.) 

- don!t have ready-made charts; paperwork; storage needs 

- time and number of workshops and training sessions both Special 
M. and mainstreaming .teachers' time. 

- that the research data behind the reliability and validity of 
measurements dp show growth In the student (both so the parent 
understands and the mainstream staff understands). 

- It would be difficult to change. All teachers should be in 
agreement of this system. 

- need more in-service. 



8) Additional comments qr recommendations. | 

- I hope this is adopted by District #16...heter way to document 
growth because can standardize testing district-wide. 
Children's needs should come before teachefs and administrators. 
We' desperately need change - maybe this will start it. 

- wish we could have spent more time understanding and discussing 
the system. Spent too much time arguing and defending it. 
need more explanation time - your expertise seemed to be wasted 
too often when you visited. 

- need this form of evaluation, but with full load gf teaching, 
organization and assistance is a problem. 



9) What percentage of time Is spent with student on collecting data? 

- - 10% - 2 

25% (or more) - 1 
30% - 1 
N/A - 2 
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